Memory and process sharing via input/output with virtualization

ABSTRACT

Embodiments of the present invention provide an approach for memory and process sharing via input/output (I/O) with virtualization. Specifically, embodiments of the present invention provide a circuit design/system in which multiple chipsets are present that communicate with one another via a communications channel. Each chipset generally comprises a processor coupled to a memory unit. Moreover, each component has its own distinct/separate power supply. Pursuant to a communication and/or command exchange with a main controller, a processor of a particular chipset may disengage a memory unit coupled thereto, and then access a memory unit of another chipset (e.g., coupled to another processer in the system). Among other things, such an inventive configuration reduces memory leakage and enhances overall performance and/or efficiency of the system.

CROSS-REFERENCE TO RELATED APPLICATION

The present patent document is a continuation of U.S. patent applicationSer. No. 13/444,025, filed Apr. 11, 2012 entitled “MEMORY AND PROCESSSHARING ACROSS MULTIPLE CHIPSETS VIA INPT/OUTPUT WITH VIRTUALIZATION”,the disclosure of which is incorporated herein by reference.

FIELD OF THE INVENTION

In general, embodiments of the present invention provide a multiplechipset circuit design. Specifically, embodiments of the presentinvention provide an approach for memory and process sharing viainput/output (I/O) with virtualization.

BACKGROUND OF THE INVENTION

With increasing demands on functionality and performance as well asimproved fabrication techniques, newer generations of processors andother integrated circuits have significantly higher levels ofintegration than their predecessors. Additionally, in some instances,different market segments may exist for compatible versions ofprocessors and other types of integrated circuits having price andperformance characteristics specific to a particular market segment.However, given the complexity and expense of designing a single versionof a processor or other integrated circuit having a large transistorcount, it may be impractical to separately design and manufacture aprocessor for each of several different market segments.

These issues may be compounded as mobile devices become more pervasive.Specifically, mobile systems typically suffer from power leakage andconsumption of their internal circuits. Currently, low-power circuitsare based on conventional design schemes. Moreover, mobile multi-coreprocessor and multi-chip systems require a fundamentally differentdesign approach for cores and on-chip memories. Under suchconfigurations, multiple chipsets may be utilized in a single system,with each chipset requiring separate memory resources. Such scatteredmemory resources may lead to extensive power leakage.

Heretofore, attempts have been made in providing improved circuitry.Such attempts include the following:

U.S. Patent Application Publication No. US 2008/0244222 discloses amethod for virtual processing.

U.S. Patent Application Publication No. US 2005/0114586 discloses amethod of performing memory mapped input/output operations to analternate address space.

U.S. Pat. No. 7,984,122 discloses an approach in which processor coredata regarding a client device is received from the client device.

U.S. Pat. No. 7,873,776 discloses a multiple-core processor with supportfor multiple processors.

U.S. Pat. No. 7,849,327 discloses a technique to improve the performanceof virtualized input/output (I/O) resources of a microprocessor within avirtual machine environment.

U.S. Pat. No. 7,552,436 discloses a method of performing memory mappedinput/output operations to an alternate address space.

Unfortunately, none of these approaches addresses issues such as powerleakage and/or consumption for multiple chipset designs.

SUMMARY OF THE INVENTION

In general, embodiments of the present invention provide an approach formemory and process sharing via input/output (I/O) with virtualization.Specifically, embodiments of the present invention provide a circuitdesign/system in which multiple chipsets are present that communicatewith one another via a communications channel. Each chipset generallycomprises a processor coupled to a memory unit. Moreover, each componenthas its own distinct/separate power supply. Pursuant to a communicationand/or command exchange with a main controller, a processor of aparticular chipset may disengage a memory unit coupled thereto, and thenaccess a memory unit of another chipset (e.g., coupled to anotherprocesser in the system). Among other things, such an inventiveconfiguration reduces memory leakage and enhances overall performanceand/or efficiency of the system.

A first aspect of the present invention provides a circuit havingmultiple chipsets, comprising: a first chipset having a first processorand a first memory unit; a second chipset having a second processor anda second memory unit; and a communication channel coupling the firstchipset to the second chipset, wherein the first processor is configuredto disengage the first memory unit and to access the second memory unit,and wherein the second processor is configured to disengage the secondmemory unit and to access the first memory unit.

A second aspect of the present invention provides a system havingmultiple chipsets, comprising: a main controller; a first chipset incommunication with the main controller, the first chipset having a firstprocessor coupled to a first power supply and a first memory unitcoupled to a second power supply; a second chipset in communication withthe main controller, the second chipset having a second processorcoupled to a third power supply and a second memory unit coupled to afourth power supply; and a communication channel coupling the firstchipset to the second chipset, wherein the first processor is configuredto disengage the first memory unit and to access the second memory unit,and wherein the second processor is configured to disengage the secondmemory unit and to access the first memory unit.

A third aspect of the present invention provides a method forvirtualizing memory within a circuit, comprising: receiving a requestfrom a main controller on a first processor of a first chipset;communicating a first set of data from the first processor to the maincontroller in response to the request; receiving a command on the firstprocessor in response to the first set of data; disengaging a firstmemory unit of the first chipset in response to the command, the firstmemory unit being coupled to the first processor; and accessing a secondmemory unit of a second chipset from the first processor in response tothe disengaging of the first memory unit, the second memory unit beingcoupled to a second processor within the second chipset.

BRIEF DESCRIPTION OF THE DRAWINGS

These and other features of this invention will be more readilyunderstood from the following detailed description of the variousaspects of the invention taken in conjunction with the accompanyingdrawings in which:

FIG. 1 depicts a diagram of chipset system according to an embodiment ofthe present invention.

FIG. 2 depicts a diagram of a chipset system in a first mode accordingto an embodiment of the present invention.

FIG. 3 depicts a method flow diagram according to an embodiment of thepresent invention.

FIG. 4 depicts another method flow diagram according to an embodiment ofthe present invention.

FIG. 5 depicts a diagram of a processor according to an embodiment ofthe present invention.

FIG. 6 depicts a diagram of a chipset in a second mode according to anembodiment of the present invention.

FIG. 7 depicts a diagram of a chipset in a third mode according to anembodiment of the present invention.

FIG. 8 depicts a diagram of multiple processors in communication withone another according to an embodiment of the present invention.

The drawings are not necessarily to scale. The drawings are merelyschematic representations, not intended to portray specific parametersof the invention. The drawings are intended to depict only typicalembodiments of the invention, and therefore should not be considered aslimiting the scope of the invention. In the drawings, like numberingrepresents like elements.

DETAILED DESCRIPTION

Illustrative embodiments will now be described more fully herein withreference to the accompanying drawings, in which exemplary embodimentsare shown. This disclosure may, however, be embodied in many differentforms and should not be construed as limited to the exemplaryembodiments set forth herein. Rather, these exemplary embodiments areprovided so that this disclosure will be thorough and complete and willfully convey the scope of this disclosure to those skilled in the art.In the description, details of well-known features and techniques may beomitted to avoid unnecessarily obscuring the presented embodiments.

The terminology used herein is for the purpose of describing particularembodiments only and is not intended to be limiting of this disclosure.As used herein, the singular forms “a”, “an”, and “the” are intended toinclude the plural forms as well, unless the context clearly indicatesotherwise. Furthermore, the use of the terms “a”, “an”, etc., do notdenote a limitation of quantity, but rather denote the presence of atleast one of the referenced items. The term “set” is intended to mean aquantity of at least one. It will be further understood that the terms“comprises” and/or “comprising”, or “includes” and/or “including”, whenused in this specification, specify the presence of stated features,regions, integers, steps, operations, elements, and/or components, butdo not preclude the presence or addition of one or more other features,regions, integers, steps, operations, elements, components, and/orgroups thereof.

Embodiments of the present invention provide an approach for memory andprocess sharing via input/output (I/O) with virtualization.Specifically, embodiments of the present invention provide a circuitdesign/system in which multiple chipsets are present that communicatewith one another via a communications channel. Each chipset generallycomprises a processor coupled to a memory unit. Moreover, each componenthas its own distinct/separate power supply. Pursuant to a communicationand/or command exchange with a main controller, a processor of aparticular chipset may disengage a memory unit coupled thereto, and thenaccess a memory unit of another chipset (e.g., coupled to anotherprocesser in the system). Among other things, such an inventiveconfiguration reduces memory leakage and enhances overall performanceand/or efficiency of the system.

As used herein, virtualization of resources refers to any number oftechniques used to share computing resources among a number of systemsand/or software applications (collectively referred to as “guest”software or entity). Virtualization techniques can broadly becategorized as employing a “dedicated policy”, in which computinghardware is partitioned and each partition is dedicated to particularguest software, or a “shared policy”, in which computing hardware isallocated to guest software according to some arbitration scheme, suchas a time-based allocation algorithm (e.g., “time multiplexing”).

Referring now to FIG. 1, a circuit system/design 10 according to anembodiment of the present invention is shown. As depicted, system 10comprises chipsets 14A-N each having a processor 16A-N that is coupledto a memory unit 18A-N. Further, each component (e.g., processors 16A-Nand memory unit 18A-N) has its own distinct/separate power supply 19A-N.As further shown, one of the processors (in this case processor 16A) canfunction and/or be assigned main controller duties. Alternatively,system 10 can comprise a distinct main controller 12 with whichprocessors 16A-N communicate. Still yet, each chip set 16A-N maycommunicate with one another via a communications channel, which can beany type of communication channel now known or hereafter developed.

Under the embodiments of the present invention, communication betweenchipsets 14A-N may include data pertaining to memory resources,throughput, performance, power, etc. As indicated above, a singlechipset (e.g., 14A) may take a controller and/or moderator role. Undersuch a configuration, the controller powers on and off (e.g., engagesand/or disengages) individual chipsets and the memory associatedtherewith. Is general, processes and memory addresses are virtualizedbetween chipsets 14A-N. Moreover, processing and memory resources may bedelegated between chipsets 14A-N.

Under the embodiments of the present invention, memory units/blocks18A-N may be diverse in size, performance, and/or power. Under previousapproaches, power consumption and leakage though all components wereextensive. Under the present invention, processors 16B-N report tocontroller 16A (or 12) about the respective processor 16B-N, subsystemspecifications, and statuses through chip-to-chip or module-to-modulecommunication channel, such Hyper Transport (HT), Quick PathInterconnect (QPI), SPI (Serial Peripheral Interface Bus), PeripheralComponent Interconnect Express (PCIe), etc. The main processor 16A pollsdata and, in response, processors 16B-N report events and requirementssuch as memory type, memory size, data latency, data rate, power,utilization, etc.

Referring now to FIG. 2, system 10 is shown when system 10 is placed ina low-power mode for low-performance processing. As depicted, memoryunit 18B was disengaged (e.g., in response to communication of data fromprocessor 16B to main controller 18A (or 12), and receipt of asubsequent command from controller 16A (or 12) in response thereto.Under such an embodiment, processor 16B would access the memory unit ofanother chipset such as memory unit 18N of chipset 14N. In general, maincontroller 16A (or 12) determines which memory units to turn off basedon power and performance requirements versus processor and memoryspecifications. Memory power supply is controlled by the processor towhich it is coupled. The processor receives command on memory modulepower supply from the main controller. Processor power supply iscontrolled by the main controller 16A or 12. In this example, processor16N virtualizes memory space in memory unit 18N for processor 16B, andenables virtualized memory access. Before memory unit 18B isdisengaged/shutdown (e.g., by disengaging power supply 19E), existingmemory contents are transferred to memory unit 18N. This configurationconserves power and prevents power leakage.

Referring now to FIG. 3, a method flow diagram according to anembodiment of the present invention is shown. As shown, in step S1, themain controller sends a request for reports to the processors in thesystem. In step S2, the processors send the request reports to the maincontroller. In step S3, the main controller determines whether anadjustment is needed. If not, the process can return to step S1 forcycling. If so, the main controller determines the system operation modebased on power and performance requirements, and then in step S5, sendsdirections/commands to the processors of the chipsets. In step S6, theprocessors send responses to the main controller where they areanalyzed. In step S7, the main controller determines from the responseswhether a further adjustment is needed. If not, the process returns tostep S1. If so, the process returns to step S4. If no, power off.

Referring now to FIG. 4, another method flow diagram according to anembodiment of the present invention is shown. As shown, in step T1, aprocessor receives a request from a main controller. In step T2, theprocessor generates a status and requirement report in response to therequest. In step T3, the processor sends the report to the maincontroller. In step T4, the processor receives direction/commands fromthe main controller. In step T5, the processor updates the setupaccording to the direction/commands received from the main controller.In step T6, it is determined (e.g., by the processor) whether anadjustment is needed. If so, a corresponding request is sent to the maincontroller in step T7, and the process returns to step T4.

Referring now to FIG. 5, a more detailed diagram of a processor 16according to an embodiment of the present invention is shown.Specifically, FIG. 5 depicts the virtualization of memory accesshereunder. As shown, each processor 16 may comprise an I/O 22 coupled toa core unit 24 that is coupled to a cache unit 26. The cache unit 26 isitself coupled to a memory controller 28 that is coupled to a memoryunit 18. Under this embodiment, I/O 22 may have DMA (Direct MemoryAccess) for internal and external services. Based on the maincontroller's direction, core unit 24 may establish DMA and a virtualizedaddress space table. When a memory access request is received fromanother processor, I/O unit 22 may directly access memory unit 18 andrespond via I/O unit 22. Core unit 24 further negotiates with the maincontroller to adjust virtualized memory size and mapping. If necessary,core unit 24 transfers virtualized memory contents to a memory unitother than the original memory unit.

Referring now to FIG. 6, an example of multiple processors-to-one memorymapping in accordance with an embodiment of the present invention isshown. As depicted, system 10 comprises the components shown anddescribed above in conjunction with FIG. 1 such as chipsets 14A-N,processors 16A-N, memory units 18A-N, power supplies 19A-N, and optionalmain controller 12. In this example, it is assumed that memory unit 18Ais relatively larger than memory units 18B-N and serves processors 16B-Nthrough virtualization. Under this embodiment, memory units 18B-N areshutdown/disengaged after the multiple-to-one virtualized mapping isperformed (e.g., by main controller 16A or 12).

FIG. 7 shows an example of one processor-to-multiple memory mapping inaccordance with an embodiment of the present invention. As depicted,system 10 comprises the components shown and described above inconjunction with FIG. 1 such as chipsets 14A-N, processors 16A-N, memoryunits 18A-N, power supplies 19A-N, and optional main controller 12.Depending on the address space assigned, memory virtualization may bedivided between multiple processors and memory units. When processor16B's memory requirement grows beyond a capacity available in processor16A through memory access/virtualization A, processor 16B extends tomemory access/virtualization B through processor 16N. Such access can beshrunk to single or reduce number of access when requirement decreases,with memory virtualization consolidation.

Referring now to FIG. 8, an example of a direct DMA-I/O-DMA transactionwith virtualization is depicted. As depicted, processors 16A-N eachcomprise the components described above such as I/O units 22A-N, coreunits 24A-N, cache units 26A-N, and memory controllers 28A-N thatcommunicate with memory units 18A-N. Under this embodiment, core units24A-N establish virtualized DMA in accordance with the main controller'spolicy. Virtualized DMA may then function directly without involvementof core units 24A-N. Such a configuration reduces latency andparticipating cores' memory-related loading.

As described hereinabove, the embodiments of the present invention allowfor main controller delegation. Under such embodiments, main controllerfunction is delegated to lower-power consuming processors when needed.The power-performance budget of the processors may be determined duringsystem design. Under this configuration, the main controller andoperating system maintain (among other things) the power and performancebudget(s) and a list of processors, as well as scenario and sequence ofpower-performance trade-offs. Typically, the main controller followspredetermined power saving policies.

The foregoing description of various aspects of the invention has beenpresented for purposes of illustration and description. It is notintended to be exhaustive or to limit the invention to the precise formdisclosed and, obviously, many modifications and variations arepossible. Such modifications and variations that may be apparent to aperson skilled in the art are intended to be included within the scopeof the invention as defined by the accompanying claims.

What is claimed is:
 1. A circuit having multiple chipsets, comprising: amain controller; a first chipset having a first processor and a firstmemory unit; a second chipset having a second processor and a secondmemory unit; and a communication channel coupling the first chipset tothe second chipset; wherein the main controller is configured to receiveat least one report from the first processor and the second processor,and send a response to the first processor and the second processor, andwherein the first processor is configured to disengage the first memoryunit based on the report and to access the second memory unit, andwherein the second processor is configured to disengage the secondmemory unit based on the at least one report and to access the firstmemory unit.
 2. The circuit of claim 1, the first processor and thesecond processor configured to communicate with a main controller. 3.The circuit of claim 2, the first processor and the second processoreach comprising: an input/output (I/O) unit; a core unit coupled to theI/O unit; a cache unit coupled to the core unit; and a memory controllercoupled to the cache unit.
 4. The circuit of claim 3, the I/O unithaving direct memory access (DMA) for internal and external services. 5.The circuit of claim 3, the core unit being configured to negotiate withthe main controller to adjust a virtualized memory size and performmemory mapping for the circuit.
 6. The circuit of claim 1, whereinprocesses and memory addresses are virtualized between the first chipsetand the second chipset.
 7. The circuit of claim 1, wherein the firstprocessor, the first memory unit, the second processor, and the secondmemory unit each has a separate power supply.
 8. The circuit of claim 1,the first processor and the second processor each being configured topoll data within the circuit.
 9. The circuit of claim 8, the datapertaining to at least one of the following: memory type, memory size,communication latency, data rate, available power, and memoryutilization.
 10. The circuit of claim 1, wherein the first processorcomprises the main controller.
 11. A system having multiple chipsets,comprising: a main controller; a first chipset in communication with themain controller, the first chipset having a first processor coupled to afirst power supply and a first memory unit coupled to a second powersupply; a second chipset in communication with the main controller, thesecond chipset having a second processor coupled to a third power supplyand a second memory unit coupled to a fourth power supply; wherein themain controller is configured to receive at least one report from thefirst processor and the second processor, and send a response to thefirst processor and the second processor, and a communication channelcoupling the first chipset to the second chipset, wherein the firstprocessor is configured to disengage the first memory unit based on thereport and to access the second memory unit, and wherein the secondprocessor is configured to disengage the second memory unit based on theat least one report and to access the first memory unit.
 12. The systemof claim 11, the first processor and the second processor eachcomprising: an input/output (I/O) unit; a core unit coupled to the I/Ounit; a cache unit coupled to the core unit; and a memory controllercoupled to the cache unit.
 13. The system of claim 12, the I/O unithaving direct memory access (DMA) for internal and external services.14. The system of claim 12, the core unit being configured to negotiatewith the main controller to adjust a virtualized memory size and performmemory mapping for the system.
 15. The system of claim 11, whereinprocesses and memory addresses are virtualized between the first chipsetand the second chipset.
 16. The circuit of claim 11, the first processorand the second processor each being configured to poll data within thesystem.
 17. The circuit of claim 16, the data pertaining to at least oneof the following: memory type, memory size, communication latency, datarate, available power, and memory utilization.
 18. The circuit of claim11, wherein the first processor comprises the main controller.